Optical multi-task learning using multi-wavelength diffractive deep neural networks

نویسندگان

چکیده

Abstract Photonic neural networks are brain-inspired information processing technology using photons instead of electrons to perform artificial intelligence (AI) tasks. However, existing architectures designed for a single task but fail multiplex different tasks in parallel within monolithic system due the competition that deteriorates model performance. This paper proposes novel optical multitask learning by designing multiwavelength diffractive deep (D 2 NNs) with joint optimization method. By encoding inputs into channels, can increase computing throughput and significantly alleviate multiple high accuracy. We design two-task four-task D NNs two four spectral respectively, classifying from MNIST, FMNIST, KMNIST, EMNIST databases. The numerical evaluations demonstrate that, under same network size, achieve higher classification accuracies than single-wavelength NNs. Furthermore, increasing simultaneously performing comparable respect individual training separately. Our work paves way developing wavelength-division multiplexing high-throughput neuromorphic photonic more general AI systems parallel.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Rapid adaptation for deep neural networks through multi-task learning

We propose a novel approach to addressing the adaptation effectiveness issue in parameter adaptation for deep neural network (DNN) based acoustic models for automatic speech recognition by adding one or more small auxiliary output layers modeling broad acoustic units, such as mono-phones or tied-state (often called senone) clusters. In scenarios with a limited amount of available adaptation dat...

متن کامل

Multi-task learning deep neural networks for speech feature denoising

Traditional automatic speech recognition (ASR) systems usually get a sharp performance drop when noise presents in speech. To make a robust ASR, we introduce a new model using the multi-task learning deep neural networks (MTL-DNN) to solve the speech denoising task in feature level. In this model, the networks are initialized by pre-training restricted Boltzmann machines (RBM) and fine-tuned by...

متن کامل

An Overview of Multi-Task Learning in Deep Neural Networks

Multi-task learning (MTL) has led to successes in many applications of machine learning, from natural language processing and speech recognition to computer vision and drug discovery. This article aims to give a general overview of MTL, particularly in deep neural networks. It introduces the two most common methods for MTL in Deep Learning, gives an overview of the literature, and discusses rec...

متن کامل

Multi-view, Multi-label Learning with Deep Neural Networks

Deep learning is a popular technique in modern online and offline services. Deep neural network based learning systems have made groundbreaking progress in model size, training and inference speed, and expressive power in recent years, but to tailor the model to specific problems and exploit data and problem structures is still an ongoing research topic. We look into two types of deep ‘‘multi-’...

متن کامل

Twitter Demographic Classification Using Deep Multi-modal Multi-task Learning

Twitter should be an ideal place to get a fresh read on how different issues are playing with the public, one that’s potentially more reflective of democracy in this new media age than traditional polls. Pollsters typically ask people a fixed set of questions, while in social media people use their own voices to speak about whatever is on their minds. However, the demographic distribution of us...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Nanophotonics

سال: 2023

ISSN: ['2192-8606', '2192-8614']

DOI: https://doi.org/10.1515/nanoph-2022-0615